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Description 

The invention concerns a neural network of the type stated in the introductory portion of claim 1 . 

Neural networks are used for data processing purposes on the basis of a plurality of complexely related input 
parameters to give the best possible response thereto without necessarily knowing the relation between the individual 
input parameters. This is extremely advantageous when no such linear relation exists. 

The starting point of neural networks is the ability of the human brain to identify the most important parameters in 
a decision-making process and to draw correct conclusions by experience. Neural networks are therefore constructed 
according to the same basic principles as the human brain, comprising a multitude of decision-making cells or neurons 
as well as connections or synapses between these. 

In order to make the best possible decisions artificial neural networks therefore go through a comprehensive learn- 
ing procedure before they are used in practice, and the experience thus acquired is utilized for adjusting the control 
parameters for the neurons and the synapses. 

As far as the neurons are concerned, these control parameters comprise a threshold value which determines 
whether the neuron concerned fires or applies an electric pulse after having received corresponding pulses from other 
neurons. The fired pulses are transferred via one or more synapses to other neurons, and the strength or the amplitude 
of the individual pulses transferred is one of the adjustable control parameters in the network. 

A plurality of learning approaches is known, by means of which the parameters can be established according to 
given applications, which takes place prior to putting the network into service. 

These include e.g. EP-A-492 641 f which discloses a neural network and a learning procedure for it. The learning 
procedure comprises submitting to the network an input data signal and a learning signai containing both desired and 
undesired data. Hereby the network will subsequently respond more expediently. If, e.g., the network controls a process 
system, it would be fatal if the network would e.g. cause an increase in temperature owing to specific input data which 
would in turn result in an increase in pressure, if the pressure was then above the value which the system could stand. 

US-A-5 107 454 discloses a neural network for use in pattern recognition, and this network is based on feedback, 
since the learning procedure is iterative, which means that the pattern concerned and the subsequent intermediate 
result patterns are run through the network. 

EP-A-405 174 discloses a learning method which ensures that the network does not "drop" in a local maximum, 
which might happen if the correlation between input and output data in a region was of a certain size. The data process- 
ing system could thus not get out of these conditions, and further adaptation would not be possible. 

US-A-5 010 512 discloses implementation of a neural network as MOSFET transistor elements. The neurons may 
here be regarded as being threshold switches having several inputs. The network can be operated in two modes, a 
learning mode in which the control parameters of the neurons are adjusted, and an associative mode in which the 
control parameters are constant. 

US-A-4 933 871 discloses an adaptive neural network which is adapted to receive input signals from an external 
system. The network may be adjusted on the basis of an external signal generated by the external system in that some 
weight factors and thus the transfer function of the network are changed. 

it may be said about prior art neural networks that following completed learning procedure they respond in the 
same manner to the same data sets, notwithstanding the surrounding in which the network controls a process, traffic 
or the like, change. 

Accordingly, the object of the invention is to provide a new generation of neural networks which possess greater 
adaptability, and where the network is currently capable of adapting io new conditions as well as new or changed 
surroundings. 

The object of the invention is achieved by the neural network claimed in Claim 1 wherein the number of firings 
from the output layer determines the threshold value so that, when the number of firings exceeds a certain value, the 
threshold value signal increases, if the number of firings has said certain value, the threshold value signal will not be 
changed, while the threshold value signal is reduced, when the number of firings is below said certain value, and 
wherein the strength of a signal q s of an output connection of a unit with state n to a unit with a state rij is updated in 
the following manner: 

q * ^ ^1 = + r(t)f (q i (t))nft)n i (t+At) / 

where 

r(t) is a feedback signal, and 
n(t) and ri; (t+At) are state signals, 
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which are responsive to the feedback signal applied to the network from said external system being controlled by the 
neural network so that . rf n(t) and n f (t+At) both assume the value 1 , then r(t)f(qj(t)) is included in the adjustment of the 
strength of a connection. 

This provides a neural network which, without being set to a specific task in advance, currently adapts rtseff. This 
also takes place in the performance of a task. 

The network of the invention can thus be used in tasks where the possible results are not known, or where they 
are difficult to define, and the network can currently adapt itself to variations in the task as well as changes in the 
desired goals. While prior art neural networks are normally adapted to a given task, it may said that the network of the 
invention automatically adapts itself, the modes of the network units and the strengths of the compounds between 
these being currently updated during the execution of a task. 

While prior art may be said to work with a learning mode and an associative memory mode, respectively, the 
network of the invention may be said to be in a performing mode, since the network continues its learning during the 
execution of a task. Even though no external feedback to a network according to the invention takes place, it will still 
possess advantages over prior art neural networks because of a local reinforcement rule and a simple evaluative 
feedback in the learning. 

The network units are preferably constructed in layers, and all the network units in a layer receive signals from 
network units in the preceding layer and emit signals to network units in the subsequent layer. It is hereby ensured 
that a direct signal transfer path is established in the network without any risk of loops being formed internally in the 
network. 

The signals which the network units emit to each other via the network connections are formed by short pulses, 
and the pulse height is one of the parameters that can be controlled when the surroundings of the network change 
dynamically When the network of the invention is implemented electronically, the pulse height regulation will normally 
be incorporated in the network connections or the synapses. In other words, the network units may be considered as 
being pulse transmitters, and the pulses propagate through the network in a chain reaction. The time it takes for the 
pulses to propagate through the network, i.e. from when a parameter is received on the input of the network until it 
provides a response on the output of the network, may be considered as being the response time of the network. 

One of the essential elements in the network of the invention is an internal activity control, e.g. implemented through 
a self-monitoring threshold value or strength adjustment. The network, which may be called a performing network, 
differs from other known, artificial networks precisely by this activity control. In a preferred embodiment of the invention, 
it is attempted to keep down the total number of pulses in the network. Thic is done by using an internal control mech- 
anism which keeps down the total number of pulses. The total signal from a region which can e.g. be identified with 
the output region, is detected. If this exceeds the unit signal, i.e. if more than one output unit fires, then the threshold 
value increases and if the total signal is below the unit signal (no signal), then the threshold value decreases. 

If it is the entire. firing frequency of the network that is monitored, it is desired that only few neurons in each layer 
fire. The threshold value can hereby be controlled so that the number of firing neurons approaches a number of the 
same order as the number of layers. This means that the number of firing neurons will be small with respect to the total 
number of neurons of the network, but will be sligthly larger than the number of neuron layers in the network. The 
network will hereby be very sensitive to changes in the dynamic conditions of the external system. 

Since the network has a natural response time (transport of signal from input to output), this mechanism gives rise 
to a complex oscillating activity signal, e.g. represented by the threshold value. It is this property that gives the network 
its adaptability. 

The sensitivity of the network is increased precisely because there is path of firing neurons through the network. 
If the input or feedback is changed, more new paths will be formed, and when new stationary modes of the external 
system occur, these new paths will be narrowed again so that there will again be a path through the network. Each 
output of the network will be associated with a predetermined action in a preferred embodiment. Correspondingly, the 
inputs of the network will be associated with sensing of corresponding action-specific parameters. This gives an un- 
surpassed adaptability to the network, since the networks adapts itself to the use concerned. Therefore, the network 
does not have to be tied to a specific use, it being possible to connect the inputs and the outputs randomly to the 
external system, since with time the feedback signal optimizes the parameters of the network to the given purpose. 

The invention also concerns a method of optimizing a neural network to changed conditions of operation, said 
method being characterized by the features defined in claim 4. 

It should be noted that the threshold value in the preferred embodiment is global, i.e. the same for all network 
neurons, while the strength of the connections is local. 

It will appear from the detailed embodiments that the network of the invention lends itself for adaptation to a given 
application, without it having been adapted to the given task beforehand. However, the invention is particularly useful 
for tasks in which the surroundings change their nature. When the network has adapted itself to a given application, it 
can also adapt itself to changes occurring in that connection.' The invention will thus be extremely useful in connection 
with networks in which learning takes place in a special learning phase, since the network of the invention will still be 
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able to adapt itself to dynamic variations in the externa! system. 

The invention will be explained more fully below in connection with the preferred embodiment and in connection 
with various examples of applications with reference to the drawing, in which: 

fig. 1 is a schematic view of a preferred embodiment of a performing network according to the invention; 

fig. 2 shows a network unit in one layer and network units in other layers connected therewith; 

fig. 3 is a schematic view of the coupling between the neurons of the network; 

figs. 4a-d are schematic views of interesting details of the control principles in connection with the preferred em- 
bodiment of a performing network according to the invention; 

fig. 5 shows the efficiency of a performing network according to the invention in connection with a first examples 
*5 of application; 

figs. 6a-c illustrate the activity of the network; 

fig. 7 illustrates the power spectrum of the network shown in fig. 5; 



figs. 8 and 9 show the efficiency of the performing network according to the invention in connection with a second 
and a third examples of application; and 

-fig. 10 shows the power spectrum of the network whose performance is shown in figs. 8 and 9. 



Fig. 1 shows a preferred embodiment of a neural network according to the invention, and the network, which is of 
the performance type, will be explained below. It will be seen that the network is constructed as a matrix of network 
units 1 or neurons, each network unit 1 being connected to one or more other network units 1 through network con- 
nections 2 or synapses. In the embodiment shown in fig. 1, the neural network is layered, the network units 1 in one 

30 layer being connected to a plurality of network units 1 in the adjacent layers. Thus, a network unit 1 receives signals 
or firings from network units 1 in the previous layer and emits signals or firings to network units in the following layer 
Neural networks of this type are called feed forward networks. It will be seen that the network has an input layer of 
network units, and these are designated 1; in the the drawing. These network units 1 ; are supplied in a manner known 
per se with an input signal in the form of the parameters to which the network is desirably to respond or react in response 

35 to the "experience" which the network has. There is likewise an output layer having network units 1 c which supply a 
response or a representation in dependence on the parameter complex applied to the input layer which is to be eval- 
uated. 

It is moreover shown schematically that the network is connected to an external system 3, and this external system 
may e.g. be a process which is controlled by the network. The network can control many different systems, examples 

40 being traffic control, control of foreign exchange transactions, control of meat quality, etc. The network units 1j on the 
input of the network receive data from the external system via a connection 5. These received data have been processed 
in advance in a manner known per se, so that data are represented in a correct data format. In dependence on this, 
the network provides the output with a response to the data applied, and this response is supplied via a connection 4 
to the external system. This response will then contain instructions on the manner in which the external system is to 

4£ be affected to achieve the desired processes. It will additionally be seen that there Is a feedback connection 6 from 
the external system, and this feedback signal affects the mode of operation of the network itself, while ordinary input 
data transferred via the connection 5 solely affect the decision-making basis for the network. It should be noted here 
that the feedback signal from the external system contains an evaluation of whether the system control of the network 
itself is good or bad. To prevent useful information from getting lost among random firings from the network units, it is 

50 generally desirable that the firing level is kept as low as possible, typically just a few firings in each network layer The 
outputs from the neurons may be coupled to a multiplier so that the signals are added. The output from this may be 
coupled to a comparator by means of which the amount of the firing may be coupled with a desired threshold value, 
and the threshold value of the network is adjusted in response to this. 

Optimization of the number of firing neurons to a predetermined desired number makes the network very sensitive 

55 to changes in the external system. It may be said that the network becomes sensitive to "criticism" from the external 
system. 

A performing network according to the invention has four dynamic elements which vary in terms of time. 

The first one of these is the network units comprising both network units contained in the actual neural network 
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and units contained in the input and output layers. The temporal mode variation of the network units corresponds to 
prior art known per se, since the variation solely depends on the signal applied to the input of the network The network 
units are putse transmitters which fire or emit a pulse, if the received complete signal exceeds a given threshold value 
T. Thus, the network units may be described by a mode n(t), where n(t) at a given time t may be expressed by: n = 0 

5 when no pulse is emitted, and n = 1 when a pulse is emitted. To use pulse transmitters as network units is essential 
according to the invention, but, naturally, it is no innovation per se. 

One of the essential elements in a performing network is the activity control, e.g. in the form of the self -monitoring 
threshold T(t). Here the performing network differs significantly from other artificial neural networks. The threshold 
value may e.g. be controlled in that the total signal from a plurality of network units in a region, e.g. the output region, 

io is detected and compared with a desired signal, the threshold value being then adjusted in response to this comparison. 
This may mean that if the total signal exceeds the unit signal, Le. if more than one output unit fires, then the threshold 
value increases, and if the total signal is below and there is thus no signal, then the threshold value decreases. This 
new idea is an internal control mechanism where the total number of pulses is kept down. The network may be com- 
posed of transistor logics, which will explained below and it will therefore have a certain response time, i.e. the time 

is it takes from the application of a signal to the input of the network to the production of a response to this signal. This 
mechanism will thus cause the threshold value to be complexely oscillating. It is La. this property that gives the network 
its adaptability. It should be mentioned here that the change in the threshold value must be relatively small over a 
period corresponding to the response time of the network. 

The third dynamic element of a performing network is the connection between the individual network units. A 

zo connection between two units just permits pulse firing in one direction. A strength q(t) is associated with each of these 
connections, q being located in the range between 0 and l . The strength q thus determines the size of a possible pulse 
which is transmitted through the connection concerned. Each network unit 1 is connected to other pulse transmitters, 
from which signals are received, through input connections. If the total, received signal exceeds the threshold value 
concerned, the network unit transmits a pulse which is spread through the output connections, the sum of the strengths 

?5 of the output connections being precisely one. The strength concept is well-known in connection with artificial neural 
networks of a known type in which the strength values are updated by pattern learning. It is here desired to strengthen 
the connections that lead to correct patterns. This frequently takes place globally according to a complicated mathe- 
matical set of rules. The strength values are currently updated in performing networks too, and this is done according 
to a simple local rule. Connections providing a positive feedback will be strengthened according to a performing network 
according to the invention, while connections providing a negative feedback are correspondingly weakened. This is 
done according to the invention by currently and locally updating or adjusting the connections where pulses are trans- 
mitted sequentially between two units. 

The performing network of the invention is connected to a peripherial user-selected system via an input and an 
output as well as a feedback which is essential to the invention and which may be described with a value r(tj. This 

?5 feedback will either be positive or negative in response to whether the network has performed its task well or badly 
and it may therefore be described as being either r = r + > 0 for a positive feedback or r = r_ < 0 for a negative feedback. 
Greater differentiation may occur. 

The feedback signal r(t) will normally not be stepped, since the individual feedbacks will be delta-shaped or in the 
form of voltage peaks. If the feedback signal occurs periodically, the signal r(t) may have the shape of a periodically 

*o jumping function with segments of exponential functions with a negative argument. 

Referring back to fig. 1, it will be seen that each network unit in the central part of the network is connected to 
three other network units in the preceding layer and to three network units in the subsequent layer This is illustrated 
in fig. 2, and it will be seen that a network unit 10 has three input connections from three network units 11-13 in the 
preceding layer with the states (n v n 2 , n 3 ), and each of these input connections have the strength (q v q 2 , q 3 ). Cor- 

!5 respondingly, the network unit 10 has three output connections with three network units 14-16 in the subsequent layer, 
and these network units 14-16 have the states (n,, n 2 , n 3 ), and the connections to these have the strengths (q v q 2 , 
q 3 ). Thus, the network unit receives a signal: 



and if this expression is greater than the threshold value T(t), the state of the unit will be n(t + At) = 1, and a pulse is 
transmitted. Otherwise, n(t + At) = 0. If more than one network unit in the output layer fires, then the threshold value 
increases by a size 5 : which means that the threshold value may be expressed by: 



so 



qiO)n,(t) + q 2 (t)n 2 (t) + q 3 (t)n 3 (t) f 



55 



T(t + At) = T(t) + 8. 
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If no network units in the output layer fires : then the threshold value decreases by a corresponding size, and a 
corresponding expression may be set up. If precisely one network unit in the output layer fires, the threshold value will 
not be changed : and the following expression of the threshold value t may be set up: 



T(t + At) = T(t). 

The strengths q,, q 2 , and q 3 are updated according to the preferred embodiment of the invention in the following 
manner: 

w 

q l "° q l ° g l (t) * r <*> f (q 1 (t))n(t)n 1 (t <* At), 

js it is noted that r(t)f (q(t)) is just included in the adjustment of the strength of a connection when the two neurons, 

which the connection connects, fire successively so that n(t) and ri 1 (t + At) both assume the value 1. 

Similar expressions may be set up for o^ and qg, and the function f (q) is here selected as a positive function which 

assumes the value 0 at the extremes of the range, and in this case f(q) may assume the value q(1-q). Further, noise 

in the system must also be taken into consideration. 
20 The strength values are fixed subsequently, so that the sum of strengths from a neuron assumes the value 1 . Then 

the strength may be expressed by: 

25 q x (t ♦ At) * q^/(q£ + % 2 <- q^)o 



Similar expressions may be set up for the strengths and o^. In the preferred embodiment the feedback value r 
(t) has one of two values at any time, and this value may either be expressed as r = r + > 0 or r = r_ < 0 for a positive 

30 feedback and a negative feedback, respectively. If no output unit fires, the value is r = r + . However, this is optional. 

Fig. 3 shows a functional diagram of the coupling between the neurons in two network layers. A network unit 1 
receives a signal on the input which is the sum of the input signals from three network units in the preceding layer. In 
a preferred embodiment, a network unit will be a flip-flop manufactured by IC technology. 

Fig. 4a shows a D-flip-flop, where the output signal on the Q output follows the input signal on the D input in the 

35 followng manner: = D n . The threshold value of the network unit is incorporated by subtracting from the input signal 
V| N a threshold value voltage corresponding to the threshold value VTh concerned and adding to said input signal a 
bias corresponding to the threshold value voltage V fjjp . nop of the flip-flop. This gives V D = V, N - + V^.^. If V D is 
greater than V fljp . nop: the flip-flop recognizes the input signal as being a 1 (D = 1), and a corresponding 1 is applied on 
the output Q. If, on the other hand, V D is smaller than V flip . flop , the flip-flop recognizes the input signal as being a 0. 

40 Correspondingly, a 0 is applied on the output. 

In a preferred embodiment, the output signal from the flip-flop is a delta voltage or a voltage pulse. The strength 
ol a connection between two neurons or network units is adjusted as follows. The output signals 27, 28 of the two 
neurons (see fig. 4b) are passed to a logic AND gate 29, and the signal from this is integrated in an integrator 30, which 
may e.g. be an operation amplifier having an integrated feedback. The signal from the integrator 30 is used for adjusting 

45 the strength of the connection. 

The actual strength adjustment takes place in the connection strength regulator 25, which is shown in fig. 3. The 
actual connection strength regulator 25 is shown in detail in fig. 4c, and it is the input V1 that receives the strength 
regulating signal from the integrator 30. 

The strength regulating element here consists of a dual gate MOSFET transistor. The gain changing, slowly varying 

so input is passed to the gate electrode of the transistor through a resistor R1 : The firing signal is likewise passed to the 
gate electrode of the transistor in which DC components, if any, are removed by a decoupling capacitor CI . The resistor 
R2 is adjusted together with the resistor Rl , R3 and R4 to provide suitable working conditions for the transistor. The 
output 01 and 02 are inverted and non-inverted, respectively. The signal on the output 02 corresponds to the signal 
on the input V2, but with a changed strength or amplitude. 

55 The signal on 02 is passed from the connection strength regulator 25 to a multiplier 26 shown in fig. 3. The firing 

signal is multiplied here with the feedback signal r(t), and it is worth noting that the AND gate 29 ensures that only 
connections between firing neurons are strengthened, as long as the network works successfully. The output from the 
multiplier 26 is coupled to a network unit 1 in the next layer of network units. 
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It is shown in fig. 4d how the feedback signal r(t) is generated. The actual neural network 34 forms part of a 
computing unit, which moreover has an input/output unit 35 which is connected via respective interfaces 37, 38 to the 
external system. The interface 37 generates input parameters for the neural network, while the interface 38 controls 
the external system in response to the output of the network. A sensing unit 31 monitors the external system, and this 

5 sensing unit 31 may e.g. be an optical sensing unit that supplies a signal to the calculating unit If the neural network 
tries to minimize the distance to the movement of a given object, the sensing unit 31 may supply a signal which rep- 
resents the distance concerned. This signal is applied to a central unit 32 which compares this signal to a previously 
measured value of the distance, and this value is obtained from a storage 33. If this distance has been made smaller, 
the central unit 32 supplies a positive feedback to the neural network 34, and the feedback value concerned is likewise 

io obtained from the storage 33. If, on the other hand, the distance has increased, a negative feedback signal is supplied 
to the neural network 34. 

In connection with a first example of application (fig. 5) the network is used for choosing a randomly selected 
activity among many, said activity being considered desirable. The network is constructed as a matrix having 64 x 64 
network elements, and there are thus 64 outputs. If the network selects the correct action, a positive feedback is applied 

15 to the network, and the positive feedback may be r = r + = 0.01 . If the network makes a wrong selection, the feedback 
will correspondingly be negative, and it may be r = r_ = -0.1 . The performance P of the network is the part of the active 
actions of the network which is desired. 

Fig. 5 shows how the performance P of the network, which has been averaged over 1000 time intervals, as well 
as the threshold value T changes with time. It will be seen that the variation of the threshold value is confined between 

20 about 0.35 and 0.50. It is also noted that the performance P increases rapidly from 0 to about 0.8, and the value of P 
fluctuates until it reaches 1 . 

Fig. 6 shows how the average activity slowly narrows. The activity has been collected over 1000 time intervals 
and is concentrated within a range 20, which is slowly narrowed down to a single path 21 . The neurons of the network 
will then form a pattern of firing neurons until either the input signal or the feedback signal changes. 

25 inset in fig. 5 is a section of the temporal fluctuations in the feedback signal r and the threshold value T The signal 

with more than 25000 time intervals was divided into 50 segments having 1024 intervals each (i.e. with 50% overlap), 
and a standard Parsen window was used for obtaining the power spectrum from these segments. Quantitatively, it will 
be seen that the power spectrum S(f) of the fluctuating reaction signal (feedback signal) exhibits a 1/f relation over a 
wide temporal range: S(f ) = constant f" a , where a is approximately equal to 1 . 1 . 

30 inset in fig. 7, the distribution D(t) is determined on the basis of five independent runs of the time intervals r, in 

which r is constant (r = r + or r = r_). In this case, this distribution may be expressed by 

-1 2 

D(t) = constant x 

35 

These graphs show that the adaptive performance in the process of learning leads to behavioural changes on a 
great variety of lapses of time. 

In connection with the next example of application the network is caused to find and follow a movable target, which 
is first assumed to move along a straigth line. In this case the network is formed by network units arranged in a 16 x 
*o 16 matrix, in which each unit in the output layer is associated with a motion of the sighting point in a predetermined 
direction and with a given size. The adjacent unit may thus be related to various motions. If several units in the output 
layer fire simultaneously, the motion is taken as the weighted average value. If the sighting point moves away from the 
object, the feedback will be negative, otherwise the feedback will be positive. 

Fig. 3 shows the linear motion of the object in dashed fine, while the sighting point is marked by a solid line, and 
this coincides with the motion of the object after a short sequence. The variations in the threshold value are likewise 
shown. The inset image shows how the sighting follows the object, and how the feedback signal reacts during this 
sequence. 

Fig. 9 shows the same case, but here the objects move along a sine curve. Here, too, the sighting point relatively 
rapidly captures the object and follows it. Here, too, the feedback signal is shown in an inset image, and both the 

so movement of the object and the movement of the sighting point may be followed. It is important to the invention that 
the feedback of the system does not lock, but constantly changes between negative and positive. It is primarily this 
that gives the performing network its adaptability and performance. 

Fig. 10 shows the power spectrum of the applications shown in figs. 8 and 9, and it will be noted that peak values 
occur in the power spectrum S(f) and in the distribution D(t), indicating that some time intervals occur particularly 

55 frequently during the performing process. According to the example of application with the linear motion of the object 
there are two peak values in the distribution D(x) ; a narrow peak being present at = 15 and a wide peak around x 2 
= 60. A separation of the distribution D(t) in two distributions D_(x) and D.(t) of a negative feedback and a positive 
feedback, respectively, shows that x 1 is related to a negative feedback, and x 2 is related to a positive feedback. This 
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indicates that peaks may occur in the distribution when the network is in the learning mode. Although just relatively 
simple examples of application have been discussed above, it will be clear to a skilled person that the network, although 
it has not been specially adapted to the given tasks, has been able to adapt itself on the basis of the feedback signal, 
which regulates the control parameters of the network units. The performance P of the network has increased to a 
s satisfactory level. Although it is still worthwhile subjecting neural networks to a learning process, the parameters being 
adjusted at the satisfactory starting level, the performance network of the invention is unique in that it is capable of 
adapting itself to changes in the surroundings. It will here be possible to compensate for ageing of the process system 
or to compensate for the possible circumstance that one or more input parameters for the network are vitiated by errors. 

10 

Claims 

1. A neural network having a plurality of network units arranged in an input layer receiving an input signal from an 
external system (3), a plurality of intermediate layers, and an output layer supplying an output signal to said external 

is system (3), each unit in an intermediate layer and the output layer being connected to a predetermined number k 

of units in the preceding layer, each unit in the input layer and an intermediate layer being connected to said 
predetermined number of units in the subsequent layer, each unit of an intermediate layer or the output layer 
receiving a combined input signal which is the sum of the output signals of the units in the preceding layer wherein 
each network unit is adapted to fire or emit an electric pulse, whereby if the input signal or the combined input 

20 signal of a unit exceeds a given controllable threshold T(t), the state n(t) of said unit being "0° when no pulse is 

emitted, and being "1 ' when a pulse is emitted, so that if the input signal or the combined input signal of said unit 
is greater than the threshold value T(t), the state of said unit will be n(t +At) = 1 , and whereby the input connections 
to a unit in an intermediate layer or the output layer have adaptable strengths q v q 2 , . q k from k units in the 
preceding layer with states n v n 2 , -.n^ so that a combined input signal is q^tjn^t) + q 2 (t)n 2 (t) + ...+ qk(t)n k (t), 

2S and whereby the output connections from a unit in the input layer and an intermediate layer have adaptable 

strengths q v q 2 , q k tok units in the subsequent layer with states n n , n 2 , ..n k , means being provided for evaluating 
the response of the network, characterized in that the number of firings from the output layer determines the 
threshold value so that, if the number of firings exceeds a certain value, the threshold value signal increases, if 
the number of firings has said certain value, the threshold value signal will not be changed, and if the number ol 

30 firings is below said certain value, the threshold value signal is reduced, and in that the strength of a signal q of 

an output connection of a unit with state n to a unit with a state n t is updated in the following manner: 

Qi-> qi = qt(t) + r(t)f (qi (t) )n(t)ru(t + At) , 

35 

where 

r(t) is a feedback signal, and 
to n(t) and rij(t+A1) are state signals, 

which are responsive to the feedback signal applied to the network from said external system being controlled by 
the neural network so that, if n(t) and nj(t+At) both assume the value 1 , then r(t)f (q^t)) is included in the adjustment 
of the strength of a connection. 

45 

2. A neural network according to claim 1 , characterized in that the signals on the output of the network units are 
formed by short pulses or firings, and that the height of a transferred pulse depends on the strength level associated 
with the firing network units. 

so 3. A neural network according to claims 1 -2, characterized in that the relative change in the threshold value over a 
period corresponding to the response time of the network is small. 

4. A method of optimizing a neural network having dynamically varying operating conditions, said neural network 
- comprising a plurality of network units arranged in an input layer receiving an input signal from an external system 
55 (3) : a plurality of intermediate layers, and an output layer supplying an output signal to said external system (3), 

each unit in an intermediate layer and the output layer being connected to a predetermined number k of units in 
the preceding layer, each unit in the input layer and an intermediate layer being connected to said predetermined 
number of units in the subsequent layer, each unit of an intermediate layer or the output layer receiving a combined 
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input signal which is the sum of the output signals of the units in the preceding layer, wherein each network unit 
is adapted to fire or emit an electric pulse, whereby if the input signal or the combined input signal of a unit exceeds 
a given controllable threshold T(t), the state n(t) of said unit being "0' when no pulse is emitted, and being '1 ' 
when a pulse is emitted so that if the input signal or the combined input signal of said unit is greater than the 

s threshold value T(t), the state of said unit will be n(t +At) = 1, and whereby the input connections to a unit in an 

intermediate layer or the output layer have adaptable strengths q v q 2 q k from k units in the preceding layer 

with states n v n 2 , ,.n k , so that a combined input signal is q-i(t)n 1 (t) + q 2 (t)n 2 (t) + ... + q k (t)n k (tj, and whereby the 
output connections from a unit in the input layer and an intermediate layer have adaptable strengths q,, c^, q k 
to k units in the subsequent layer with states n v n^, ..n^, the response of the network being moreover evaluated, 

10 characterized in that the number of firings from the output layer, is used for determining the threshold value so 

that when the number of firings exceeds a certain value, the threshold value increases, if the number of firings has 
said certain value, the threshold value signal will not be changed, while the threshold value is reduced when the 
number of firings is below said certain value, and in that the strength of a signal c- of an output connection of a 
unit with state n to a unit with a state n t is updated in the following manner 



qi-> = q<(t) + r ( t ) f (q 4 ( t ) ) n ( t ) ru ( t+At ) , 



20 where 



r(t) is a feedback signal, and 
n(t) and jTj(t+At) are state signals, 



2S which are responsive to the feedback signal applied to the network from said external system being controlled by 

the neural network so that, if n(t) and n^t+At) both assume the value 1 , then r(t)f(qj(t)) is included in the adjustement 
of the strength of a connection. 

30 Patentanspruche 

1. Neuronales Netzwerkmit einer Vielzahl von Netzwerkeinheiten, die in einer Eingangsschicht angeordnetsind, die 
ein Eingangssignal aus einem externen System (3) empfangt, einer Vielzahl von Zwischenschichten und einer 
Ausgangsschicht die ein Ausgangssignal an das externe System (3) liefert, wobei jede Einheit in einer Zwischen- 

3S schicht und der Ausgangsschicht zu einer zuvor festgelegten Anzahl k von Einheiten zusammengeschlossen sind, 

wobei jede Einheit in der Eingangsschicht und einer Zwischenschicht zu einer zuvor festgelegten Anzahl von 
Einheiten in der darauffolgenden Schicht zusammengeschlossen sind, wobei jede Einheit einer Zwischenschicht 
oder der Ausgangsschicht ein kombiniertes Eingangssignal empfangt, das die Summe der Eingangssignale der 
Einheiten in der vorhergehenden Schicht darstellt, bei dem jeweils ein Netzwerk zum Zunden oder Emittieren eines 

40 elektrischen Impulses ausgelegt ist, wobei, falls das Eingangssignal oder das kombinierte Eingangssignal einer 

Einheit einen vorgegebenen steuerbaren Schwellwert T(t) ubersteigt, der Zustand n(t) der Einheit "0" ist, wenn 
kein Impuls emittiert wird, und "1" ist, wenn ein Impuls emittiert wird, so da(3, falls das Eingangssignal oder das 
kombinierte Eingangssignal der Einheit groBer ist als der Schwellwert T(t), der Zustand der Einheit n(t+At)=1 ist, 
und wobei die Eingangsverbindungen zu einer Einheit in einer Zwischenschicht oder der Ausgangsschicht die 

4$ anpassungsfahigen Starken q v q 2 , q k aus den k Einheiten der vorhergehenden Schicht mit den Zustanden 

h v n 2 , .... n k aufweisen, sodaB ein kombiniertes Eingangssignal q^tjn^t) + q 2 (t)n 2 (t) + ... + q k (t)n k (t) lautet, und 
wobei die Ausgangsverbindungen von einer Einheit in der Eingangsschicht und einer Zwischenschicht die anpas- 
sungsfahigen Starken q v o^, ... q k zu den k Einheiten der darauffolgenden Schicht mit den Zustanden n,, r^, ... 
n k aufweisen, wobei Einrichtungen zur Bewertung des Ansprechverhaltens des Netzwerkes vorgesehen sind, da- 

50 durch gekennzeichnet, dafc die Anzahl der Zundungen aus der Ausgangsschicht den Schwellwert bestimmt, so 

daG, falls die Anzahl der Zundungen einen bestimmten Wert ubersteigt, das Schwellwertsignal zunimmt, falls die 
Anzah I der Zundungen einen bestimmten Wert besitzt, das Schwellwertsignal nicht verandert wird, und falls Anzahl 
der Zundungen unterhalb des bestimmten Wertes liegt, das Schwellwertsignal verkleinert wird, und dadurch daf3 
die Starke einen Signals c$ einer Ausgangsverbindung einer Einheit mit dem Zustand n zu einer Einheit mit einem 

55 zustand rtj auf f olgende Weise aktualisiert wird: 
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qi qi = qi(t) + r (t)f (qt<t) )n(t)ni<t:+At) , 



worm . 



r(t) fur ein Ruckkoppelsignal steht, und 

n(t) und nj(t+At) f Or Zustandssignale stehen, 

die auf das Ruckkoppelsignal ansprechen, das von dem externen System, das von dem neuronalen Netzwerk 
gesteuert wird, an das Netzwerk angeiegt wird, so daB. falls n(t) und r»j(t+At) beide den Wert 1 annehmen, r(t)f(qj 
(t)) dann in der Einstellung der Starke einer Verbindung eingeschlossen ist. 

Neuronaies Netzwerk nach Anspruch 1 , dadurch gekennzeichnet, daB die Signale des Ausgangs der Netzwerk- 
einheiten von kurzen Impuisen oder Zundungen gebildet sind und daf3 die Hohe eines ubertragenen Impulses von 
dem mit den zundenden Netzwerkeinheiten zusammenhangenden Starkeniveau abhangt. 

Neuronaies Netzwerk nach den Anspruchen 1-2, dadurch gekennzeichnet, daB die relative Anderung im Schwell- 
wert uber einen Zeitraum, der der Ansprechzeit des Netzwerkes entspricht, relativ gering ist. 

Verfahren zur Optimierung eines neuronalen Netzwerkes mit dynamisch schwankenden Betriebshedingungen, 
wobei das neuronale Netzwerk eine Vielzahl von Netzwerkeinheiten, die in einer Eingangsschicht angeordnet sind, 
die ein Eingangssignal aus einem externen System (3) empfangl, eine Vielzahl von Zwischenschichten und eine 
Ausgangsschicht : die an das externe System (3) ein Ausgangssignal liefert, umfaBt, wobei jede Einheit in einer 
Zwischenschicht und der Ausgangsschichl zu einer zuvor festgelegten Anzahl k von Einheiten zusammenge- 
schlossen sind, wobei jede Einheit in der Eingangsschicht und einer Zwischenschicht zu einer zuvor festgelegten 
Anzahl von Einheiten in der darauffolgenden Schicht zusammengeschlossen sind, wobei jede Einheit einer Zwi- 
schenschicht oder der Ausgangsschicht ein kombiniertes Eingangssignal empfangt das die Summe der Eingangs- 
signaie der Einheiten in der vorhergehenden Schicht darstellt, bei dem jeweils ein Netzwerk zum Zunden oder 
Emittieren eines elektrischen Impulses ausgelegt ist, wobei, falls das Eingangssignal oder das kombinierte Ein- 
gangssignal einer Einheit einen vorgegebenen steuerbaren Schwelfvert T(t) ubersteigt, derZustand n(t) der Einheit 
"0" ist : wenn kein Impuls emittiert wird, und '1 ' ist, wenn ein Impuls emittiert wird, so daB, falls das Eingangssignal 
oder das kombinierte Eingangssignal der Einheit groBer ist als der Schwellwert T(t), der zustand der Einheit n 
(t+At)=1 ist, und wobei die Eingangsverbindungen zu einer Einheit in einer Zwischenschicht oder der Ausgangs- 
schicht die anpassungsfahigen Starken q v q 2 , .... q k aus den k Einheiten der vorhergehenden Schicht mit den 
Zustanden n,, n 2 .„, n k aufweisen, so daB ein kombiniertes Eingangssignal q t (t)n , (t) + q 2 (t)n 2 (t) + ... + q k (t)n k 
(t) lautet : und wobei die Ausgangsverbindungen von einer Einheit in der Eingangsschicht und einer Zwischen- 
schicht die anpassungsfahigen Starken q v q 2 , ... q k zu den k Einheiten der darauffolgenden Schicht mit den Zu- 
standen n v H2' ... n k aufweisen, wobei das Ansprechverhaiten des Netzwerkes auBerdem bewertet wird, dadurch 
gekennzeichnet, daB die Anzahl der Zundungen aus den Ausgangsschichten zur Bestimmung des Schwellwertes 
eingesetzt wird, so daB, wenn die Anzahl der Zundungen einen bestimmten Wert ubersteigt, der Schwellwert 
zunimmt falls die Anzahl der Zundungen einen bestimmten Wert besitzt, das Schwellwertsignal nicht verandert 
wird, wahrend der Schwellwert verkleinert wird, wenn die Anzahl der Zundungen unterhalb des bestimmten Wertes 
liegt, und dadurch daB die Starke eines Signals q, einer Ausgangsverbindung einer Einheit mit dem Zustand n zu 
einer Einheit mit einem Zustand rij auf folgende Weise aktualisiert wird: 



qi -> qx • q*(t> + r <t>f (qi<tnn(t)ni<t+At) , 



worm 



r(t) fur ein Ruckkoppelsignal steht, und 



n(t) und nj{t+At) fur Zustandssignale stehen, 



die auf das Ruckkoppelsignal ansprechen, das von dem externen System, das von dem neuronalen Netzwerk 
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gesteuert wird, an das Nelzwerk angelegt wird, so daG. falls n(t) und nrft+At) beide den Wert 1 annehmen, r(t)f(qi 
(t)) dann in der Einstellung der Starke einer Verbindung eingeschlossen ist 



5 Revendications 

1. Reseau neuronal ayant une pluralite d'unites de reseau places dans une couche d'entree recevant un signaJ d'en- 
tree depuis un systeme externa (3), une pluralite de couches intermediates et une couche de sortie foumissant 
un signal de sortie audit systeme exteme (3), chaque unite d'une couche intermediaire et de la couche de sortie 
w etant connectee a un nombre predetermine k d'unites de la couche precedente, chaque unite de la couche d'entree 

et d'une couche intermediaire etant connectee audit nombre predetermine d'unites de la couche suivante, chaque 
unite d'une couche intermediaire ou de la couche de sortie recevant un signal d'entree combine qui est la somme 
des signaux de sortie des unites de la couche precedente, 

dans lequel chaque unite de reseau est adapted pour amorcer ou emettre une impulsion electrique, 

is 

par lequel si le signal d'entrde ou le signal d'entree combine d'une unite excede un seuil commands donne T 
(t), l'6tat n{t) de ladite unite 6tant '0' iorsque aucune impulsion n'est emise et 6tant °1 B lorsqu'une impulsion 
est emise afin que, dans le cas ou le signal d'entree ou le signal d'entree combine de cette unite excede le 
valeur de seuil T(t), I'etat de ladite unite sera n(t+At) = 1 , et 
20 par lequel les connexions cfentr6e a une unite d'une couche intermediaire ou de la couche de sortie ont des 

poids adaptablesq-,, q 2 , q k depuis k unites de la couche precedente avec des etats n 1f n 2 , .... n k , de sorte 
qu'un signal d'entree combine est q 1 (t)n 1 (t) + q 2 (t)n 2 (t) + — + ^kM" k0)» et 

par lequel les connexions de sortie depuis une unite de la couche d'entree et d'une couche intermediaire ont 
des poids adaptabtes q v q 2 , .... q k & k unites de la couche suivante ayec des etats n v n 2 . .... n^ un moyen 

25 etant foumi pour evaluer la reponse du reseau, caracterise en ce que le nombre d'amorcages depuis la couche 

de sortie determine la valeur de seuil de sorte que, si le nombre d'amorcages depasse une certaine valeur, 
le signal de valeur de seuil augmente, si le nombre d'amorcages est egal a ladite certaine valeur, le signal de 
valeur de seuil ne sera pas change, el si le nombre d'amorcages est inf erieur a ladite certaine valeur, le signal 
de valeur de seui! est reduit et en ce que le poids d'un signal q, d'une connexion de sortie d'une unite avec 

30 un etat n vers une unite avec un 6tat r\ } est mis a jour de la maniere suivante: 

q, ^ q. * qi(t) ♦ r(t> f(q,(t)) n(i) o(l*A0 



35 



40 



Ou 



r(t) est un signal de retour et 
n(t) et r>j(t+At) sont des signaux d'etats, 

qui sont sensibles au signal de retour applique au reseau depuis ledit systeme externe commande par 
le reseau neuronal de sorte que, si n(t) et n^'t+At) prennent tous deux la valeur 1, alors r(t) f(qj(t)) est inclus 
dans le reglage du poids d'une connexion. 

45 2. Reseau neuronal selon la revendication 1 , caracterise en ce que les signaux en sortie des unites de reseau sont 
formes d'impulsions courtes ou d'amorcages, et en ce que la hauteur d'une impulsion transferee depend du niveau 
de poids associe aux unites de reseau amorcantes. 

3. Reseau neuronal selon les revendications 1-2, caracterise en ce que ta variation relative de la valeur de seuil 
so sur une periode correspondant au temps de reponse du reseau est faible. 

4. Procede d'optimisation d'un reseau neuronal ayant des conditions de fonctionnement variant dynamiquement, 
ledit reseau neuronal comprenant une pluralite d'unites de reseau placee dans une couche d'entree recevant un 
signal d'entree depuis un systeme exteme (3), une pluralite de couches intermediates et une couche de sortie 

55 fournissant un signal de sortie audit systeme exteme (3), chaque unite d'une couche intermediaire et de la couche 

de sortie etant connectee a un nombre predetermine k d'unites de la couche precedente, chaque unite de la couche 
d'entree et d'une couche intermediaire etant connectee audit nombre predetermine d'unites dans la couche sui- 
vante, chaque unite d'une couche intermediaire ou de la couche de sonie recevant un signal d'entree combine qui 
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est la somme des signaux de sortie des unites de la couche precedente, 

dans lequel chaque unite de reseau est adaptee pour amorcer ou emettre une impulsion electrique, 

par lequel si le signal d'entree ou fe signal d'entree combine d'une unite excede un seuil commande donne T 
(t), I'etat n(t) de ladite unite etant "0" lorsque aucune impulsion n'est emise et etant "1 ■ lorsqu'une impulsion 
est emise, I'etat de ladite unite sera n(t+At) = 1 , et 

par lequel les connexions d'entree a une unite d'une couche intermediaire ou de la couche de sortie ont des 

poids adaptables q , , q 2 , .... q k depuis k unites de la couche precedente avec des etats n,,n 2 n k , de sorte 

qu'un signal d'entree combine est q^tjn^t) + q 2 (t)n 2 (t) + ... + q«<t)n k (t), et 

par lequel les connexions de sortie depuis une unite de la couche d'entree et d'une couche intermediaire ont 
des poids adaptables q v o^, .... q k a k unites de la couche suivante avec des etats n v r^, .... n k , 

la reponse du reseau etant de plus evaluee, caracterise en ce que le nombre d'amorcages depuis la couche 
de sortie est utilise pour determiner la valeurde seuil de sortie que, lorsque le nombre d'amorcages depasse 
une certaine valeur, la valeur de seuil augmente, si le nombre d'amorcages est egal a ladite certaine valeur, 
le signal de valeur de seuil ne sera pas change, alors que la valeur de seuil est reduite lorsque le nombre 
d'amorcages est inf erieur a ladite certaine valeur, et en ce que le poids d'un signal q d'une connexion de sortie 
d'une unite avec un etat n vers une unite avec un etat nj est mis a jour de la maniere suivante: 



= q*(t) * r(i) f( qi (t)) n(t) $(t+M) 

Ou 

r(t) est un signal de retour et 

n(t) et jQi(t+At) sont des signaux d'etats, 

qui sont sensibles au signal de retour applique au reseau depuis ledit systeme externe commande par 
le reseau neuronal de sorte que, si n(t) et nrft+At) prennent tous deux la valeur 1, alors r(t) f(qj(t)) est inclus 
dans le reglage du poids d'une connexion. 




12 



# 



EP 0 749 601 B1 



m 



T 
S 



INPUT 




Hi Z? 2 2?j 

F/6.2 



13 



EP 0 749 601 B1 



+ 



25 




25 




25 




>2 



Fid. J 



D Q 
Q 



no. 4o 



27 



28 



29 ,30 



Rl 

V) O WAVr 

^2 o » 

CI 



/?4 



-o0/ 



*2 



-o 02 



14 




16 




17 




18 




19 



EP 0 749 601 B1 




20 



